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1.  Introduction 
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The  research  performed  at  UCSD  for  the  AF  RADC  Contract  had  two  main  goals. 

a)  The  improvement  of  optical  pattern  recognition  reliability.  This  was  to  be  achieved  by 
incorporating  new  recognition  algorithms  into  the  design  of  pattern  recognition  filters, 
thereby  allowing  the  combination  of  the  speed  of  optics  with  the  reliability  of 
algorithms  usually  reserved  for  digital  processing  [1,2]. 

b)  The  improvement  of  the  optical  efficiency  of  spatial  filters,  in  order  to  allow  the  use  of 
smaller,  lower  power  lasers  for  pattern  recognition. 

In  this  report  we  will  review  and  summarize  the  research  done  at  UCSD  from  March 
1985  to  F ebruary  1987.  The  degree  to  which  the  two  goals  were  met  will  be  evaluated. 

2.  Algorithm  Study 

A)  Optical  Implementation  of  New  Algorithms 
1)  Database  creation 

Two  new  image  data  bases  were  generated.  This  was  done  in  order  to  incorporate  both 

interclass  as  well  as  intraclass  statistical  variation  in  our  training  and  test  image  sets  for 

/ 

the  first  database  and  rotationally  varying  samples  of  two  classes  for  the  second 
database.  The  first  database  consisted  of  512  x512  gray  tone  (0  to  255)  images  of  10 
tanks  and  10  trucks.  (See  Status  Report:  March- April,  1985.)  In  the  second, 
rotationally  variant  database  two  airplanes  were  rotated  by  increments  of  5  and  10 
degrees  to  obtain  72  and  36  respectively  samples  for  each  class.  (See  Status  Report: 
December  1985-January  1986.) 
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2)  Implementation  of  new  statistical  algorithms 

In  addition  to  previously  studied  feature  extraction  algorithms  (e.g.,  Fukunaga-Koontz 
(F-K)  [l]  ajid  Hotelling  Trace  Criterion  (HTC)  [2])  we  studied  and  implemented  the 
Foley-Sammon  (F-S)  transform  which  was  applied  to  the  older  birds-eind-fish  database 
with  good  results:  100%  correct  classification  with  both  the  training  and  test  data. 

(See  Status  Report:  March-April  1985  and  Publication  #1.) 

3)  Pattern  recognition  of  images  submerged  in  noise 

The  effect  that  the  addition  of  white  noise  had  on  the  recognition  of  a  2-class  problem 
employing  the  least  squares  linear  mapping  technique  (LSLMT)  algorithm  [3]  was 
evaluated.  The  white  noise  was  treated  as  third  class  object.  Good  recognition  results 
were  demonstrated  for  a  signal-to-noise  ratio  as  low  as  0.2.  (See  Status  Report: 
March-April  1985  and  Publication  f  2.) 

B)  Comparison  study  of  linear  mapping  and  eigenvector-based  algorithms. 

Most  statistical  pattern  recognition  algorithms  cam  be  grouped  into  two  classes:  lineax 
mapping  methods  and  feature  extraction  methods.  The  LSLMT,  Simplified  LSLMT 
(SLSLMT),  [4]  and  Synthetic  Discriminant  Function  [5]  (SDF)  aire  examples  of  linear 
mapping  methods,  while  the  F-K,  F-S,  HTC,  Linear  Discriminamt  Function  (LDF)  [6]  and 
Generalized  Matched  Filter  (GMF)  [7j  axe  examples  of  eigenvector-based  feature  extraction 
methods  of  pattern  recognition.  (See  Status  Reports:  May-June,  July-August,  September- 
November  1985  and  Publications  fZ  amd  4.) 

1)  Lineair  mapping  methods 

In  this  study  we  formulated  the  generailized  lineau’  mapping  (GLM)  method,  which  for 
special  cases  cam  be  reduced  to  the  LSLMT,  SLSLMT  and  SDF  algorithms.  When  the 
number  of  training  images  is  smaller  than  the  number  of  image  pixels,  i.e.,  the 
underdetermined  case,  the  GLM,  LSLMT  amd  SDF  algorithms  were  shown  to  be 
identical.  For  the  overdetermined  case  when  the  number  of  training  images  is  laurger 
tham  the  number  of  image  pixels,  the  LSLMT  amd  GLM  were  found  to  be  identical. 
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whereas  the  SDF  algorithm  was  undefined  for  that  case.  This  was  then  verified 
experimentally  using  the  birds-fish  and  tank-truck  database.  (See  Status  Report: 
May-Jtxne,  1985.) 

In  addition,  the  GLM  was  compared  on  a  theoreticcil  basis  with  the  Caulfield-Maloney 
filter  (CMF)  [8],  the  equal  correlation  peak  (ECP)  [9]  technique,  and  the  SLSLMT. 
The  CMF  and  ECP  again  were  shown  to  be  special  cases  of  the  GLM.  The  SLSLMT 
was  shown  to  be  identical  to  the  GLM  for  images  of  Markov-1  process.  It  was  also 
noted  that  the  SLSLMT  has  a  computational  advantage  over  both  the  LSLMT  and 
SDF  algorithms.  (See  Status  Report:  July-August,  1985  and  Publication  #3.) 

2)  Eigenvector  based  methods 


A  theoretical  comparison  of  eigenvector-based  algorithms  such  as  the  FS,  HTC,  FK, 
LDF  and  GMF  was  also  performed.  It  has  been  shown  that  all  the  eigenvector  based 
methods  can  be  represented  in  the  generalized  eigenvector  form.  However,  the 
calculations  of  the  discriminant  vectors  are  diflferent  for  different  algorithms  (summaries 
on  how  to  calculate  the  discriminant  functions  for  the  FS,  HTC  and  FK  transforms  are 
provided  in  publication  #4).  We  also  compared  theoretically  the  classification 
effectiveness  of  the  discriminant  functions  generated  from  the  FS,  HTC  amd  FK 
algorithms  with  those  generated  with  the  LDF  and  GMF  as  well  as  the  discriminant 
functions  generated  from  the  lineair  mapping  based  algorithms  with  those  using 
eigenvector  based  methods.  The  experimental  compau'ison  was  performed  using  the 
birds-fish  amd  the  tank-truck  database.  (See  Publication  f4.) 

C)  Comparison  of  algorithm  sensitivity  to  image  rotation 


The  statistical  pattern  recognition  algorithms  LSLMT,  SLSLMT,  FS,  HTC  and  FK 
were  applied  to  the  rotation  varying  database.  We  foimd  that  the  linear  mapping  based 
algorithms  were  not  as  sensitive  to  rotation  as  the  eigenvector  based  algorithms,  needing 
only  12  rotated  images  to  correctly  classify  the  test  set  compared  to  72-180  for  the 
eigenvector  based  algorithms.  The  linear  mapping  based  algorithms  ue  more  robust  when  ‘ 
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faced  with,  rotation  than  the  eigenvector  based  algorithms.  (See  Status  Report:  February- 
March,  1986.) 

3.  Phase  Only  Filtering 

Phase  only  (PO)  filtering  was  also  investigated  [8,9].  The  effects  of  PO  filtering  on 
such  characteristics  as  the  Homer  efiiciency  of  the  filter,  the  correlation  peak  intensity,  the 
correlation  spot  size,  and  the  signal-to-noise  ratio  of  the  correlation  function  were  evaduated. 

For  linear  mapping-based  algorithms,  e.g.,  the  LSLMT  and  SLSLMT,  the  PO  filtering 
increased  the  peak  correlation  intensity  and  the  signal-to-noise  ratio.  The  Homer  efficiency 
did  not  seem  to  be  improved  and  the  classification  realiability  remained  about  the  same  as 
compared  to  amplitude  and  phase  (AP)  filtering.  (See  Status  Reports:  July-August,  1986, 
September-October,  1986.) 

For  eigenvector-based  algorithms,  e.g.,  the  HTC,  FS  and  FK  algorithms,  the  PO 
filtering  decreased  the  spot  size  while  increasing  the  peak  correlation  intensity.  The  signal- 
to-noise  ratio  and  the  Homer  efficiency  did  not  seem  to  be  improved  while  the  classification 
reliability  again  remained  about  the  same  as  for  the  AP  filtering.  (See  Stat\is  Report: 
November-December,  1986.) 

A  point  needs  to  be  made  concerning  the  classification  reliability  of  phase  only  filtering. 
While  it  is  true  that  the  classification  realiability  was  not  overly  degraded  by  the  use  of 
phase  only  filters,  a  limited  database  was  used.  The  results  for  the  tank-truck  database  may 
not  be  applicable  to  other  and  larger  database. 

4.  Summary  wd  Couelusion 

To  meet  the  goal  of  improvement  of  optical  pattern  recognition,  we  have  studied  and 
experimentally  verified  new  computation  methods  for  the  FS  algorithm,  and  extended  the 
LSLMT  algorithm  to  the  case  of  images  corrupted  by  additive  noise.  We  also  theoretically 
and  experimentally  studied  the  algorithms  based  on  solutions  to  linear  mapping  and 
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generalized  eigenvalue  problems.  The  robtistness  of  these  algorithms  with  respect  to 
statistical  variations  and  rotations  of  training  data  was  investigated  using  the  tank-truck 
and  rotated  airplzme  database  respectively.  The  two  groups  of  algorithms  were  zJso 
employed  to  compare  their  performance  characteristics  in  using  PO  versus  AP  filtering. 

5.  List  of  Publications  during  the  granting  period. 

1.  Z.  H.  Gu  and  S.  H.  Lee,  "Classification  of  multiclassed  stochastic  images  buried  in 
additive  noise,"  J.  Opt.  Soc.  Am.  A:4,  pp.  712-719,  1987. 

2.  Q.  Tian,  M.  Barbero,  Z.  H.  Gu  and  S.  H.  Lee,  "Image  classification  by  Foley-Sammon 
transform,"  Opt.  Eng.,  25,  pp.  834-840,  1986. 

3.  Q.  Tian,  Y.  Fainman,  Z.  H.  Gu  and  S.  H.  Lee,  "Comparison  of  statistical  pattern 
recognition  algorithms  for  hybrid  processing.  Part  I:  Linear  mapping  algorithms," 
submitted  to  J.  Opt.  Soe.  Am.,  Dec.  1986. 

4.  Q.  Tian,  Y.  Fainman  and  S.  H.  Lee,  "Comparison  of  statisticed  pattern  recognition 
algorithms  for  hybrid  processing.  Part  11:  Eigenvector-based  algorithms,"  submitted  to 
J.  Opt.  Soc.  Am.,  Dec.  1986. 

6.  References 

1.  J.  R.  Leger  and  S.  H.  Lee,  "Image  classification  by  an  optical  implementation  of  the 
Fukunaga-Koontz  trzmsform,"  J.  Opt.  Soe.  Amer.,  72,  1982,  pp.  556-564. 

2.  Z.  H.  Gu  and  S.  H.  Lee,  "Optical  implementation  of  the  Hotelling  Trace  Criterion  for 
image  classification."  Opt.  Eng.,  23  (6),  1984,  pp.  727-731. 

3.  Z.  H.  Gu,  J.  R.  Leger  and  S.  H.  Lee,  "Optical  implementation  of  the  least-squares 
linear  mapping  technique  for  image  classification,"  J.  Opt.  Soe.  Amer.,  72,  1982,  pp. 


787-793. 


-  6  - 


4.  Z.  H.  Gu  and  S.  H.  Lee,  "Recognition  of  images  of  Markov-1  model  by  least-squares 
linear  mapping  technique."  Appl.  Opt.,  23  (6),  1984,  pp.  822-827. 

5.  D.  Casasent,  W.  Rozzi  and  D.  Fetterly,  "Projection  synthetic  discriminant  function 
performances,"  Opt.  Eng.  23,  1984,  pp.  716-720. 

6.  D.  Casasent  and  W.  T.  Chang,  "Generalized  chord  transformation  for  distortion 
invariant  optical  pattern  recognition,"  Appl.  Opt.  22,  1983,  pp.  2087. 

7.  H.  J.  Caulfield  and  M.  H.  Weinberg,  "Computer  recognition  of  2-D  patterns  using 
generalized  matched  filters,"  Appl.  Opt,  21,  1982,  pp.  1699-1704. 

8.  H.  J.  Caulfield  and  W.  T.  Maloney,  "Improved  discrimination  in  optical  character 
recognition,"  Appl.  Opt.  8,  1969,  pp.  2354. 

9.  B.  V.  K.  V.  Kumar,  E.  Pockapsky  and  D.  casasent,  "Optimality  considerations  in 
modified  spatial  filtering,"  Proc.  SPIE  519,  1984,  pp.  85. 

10.  J.  L.  Homer,  "Light  utilization  in  optical  correlator,"  Appl.  Opt.,  21,  1982,  p.  4511. 

11.  J.  L.  Homer  and  P.  D.  Gianino,  "Phase-only  matched  filtering,"  Appl.  Opt.,  23,  1984, 

pp.  812-816. 


MISSION 

of 

Rome  Air  Development  Center 


RADC  plans  and  executes  research,  development,  test  and  selected 
acquisition  programs  in  support  of  Command,  Control,  Communications 
and  Intelligence  (C^I)  activities.  Technical  and  engineering  support  within 
areas  of  competence  is  provided  to  ESD  Program  Offices  (POs)  and  other 
ESD  elements  to  perform  effective  acquisition  of  C^I  systems.  The  areas 
of  technical  competence  include  communications,  command  and  control, 
battle  management,  information  processing,  surveillance  sensors, 
intelligence  data  collection  and  handling,  solid  state  sciences, 
electromagnetics,  and  propagation,  and  electronic,  maintainability,  and 
compatibility. 


